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Abstract 

Symmetry is an important factor in solving many constraint 
satisfaction problems. One common type of symmetry is 
when we have symmetric values. In a recent series of pa- 
pers, we have studied methods to break value symmetries 
dWalsh 2006al IWalsh 20071 . Our results identify computa- 
tional limits on eliminating value symmetry. For instance, we 
prove that pruning all symmetric values is NP-hard in general. 
Nevertheless, experiments show that much value symmetry 
can be broken in practice. These results may be useful to 
researchers in planning, scheduling and other areas as value 
symmetry occurs in many different domains. 



Introduction 

Many search problems contain symmetries. Symmetry oc- 
curs naturally in many problems (e.g. if we have identical 
machines to schedule, identical jobs to process, or equiva- 
lently skilled personnel to roster). Symmetry can also be 
introduced when we model a problem (e.g. if we name the 
elements in a set, we introduce the possibility of permuting 
their order). Unfortunately, symmetries increases the size 
of the search space. If we do not eliminate symmetries, we 
will waste much time visiting symmetric solutions, as well 
as those parts of the search tree which are symmetric to al- 
ready visited states. 

One common type of symmetry is when values are sym- 
metric. For example, if we are assigning colors (values) to 
nodes (variables) in a graph coloring problem, we can uni- 
formly swap the names of the colors throughout a coloring. 
As a second example if we are assigning nurses (values) to 
shifts (variables) in a rostering problems, and two nurses 
have the same skills, we may be able to interchange them 
uniformly throughout the schedule. In a recent series of 
papers (IWalsh 2006al IWalsh 2007 ). we have studied meth- 
ods to eUminate such value symmetries. A clear picture 
of breaking value symmetry is emerging from these stud- 
ies. These results may be useful to researchers in other areas 
of AI as value symmetry is a common feature of many do- 
mains. 
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An example 

To illustrate the ideas, we consider a simple problem 
from musical composition. The all interval series problem 
(prob007 in CSPLib.org) asks for a permutation of the num- 
bers to n — 1 so that neighbouring differences form a per- 
mutation of 1 to n — 1. For n = 12, the problem corresponds 
to arranging the half-notes of a scale so that all musical in- 
tervals (minor second to major seventh) are covered. This is 
a simple example of a graceful graph problem in which the 
graph is a path. 

We can model this as a constraint satisfaction problem in 
n variables with Xi = j iff the ith number in the series is j. 
One solution for n — 11 is: 



Xi,X2, . . . , Xii 



3,7,4,6,5,0,10,1,9,2,8 (1) 



The all interval series problem has a number of different 
symmetries. First, we can reverse any solution and generate 
a new (but symmetric) solution: 

Xi,X2,...,Xn = 8,2,9,1,10,0,5,6,4,7,3 (2) 

Second, the all interval series problem has a value symmetry 
as we can invert values. If we subtract all values in (1) from 
10, we generate a second (but symmetric) solution: 



X^ , X2 



,Xn = 7,3,6,4,5,10,0,9,1,8,2 (3) 



Third, we can do both and generate a third (but symmetric) 
solution: 



Xl,X2 



2,8,1,9,0,10,5,4,6,3,7 (4) 



To eliminate such symmetric solutions from the search 
space, we can post additional constraints which eliminate 
all but one solution in each symmetry class. To eliminate 
the reversal of a solution, we can simply post the constraint: 



Xi < Xn 



(5) 



This eUminates solution (2) as it is a reversal of (1). 

To eliminate the value symmetry which subtracts all val- 
ues from 10, we can post: 

Xi<10-Xi, Xi = 10-^1 =»X2 < 10- (6) 

This is equivalent to: 

^1 < 5, Xi = 5^ X2 <5 



This eliminates solutions (2) and (3). Finally, eliminating 
the third symmetry where we both reverse the solution and 
subtract it from 10 is more difficult. We can, for instance, 
post: 

Xi < 10 -Xn, 
Xi = 10-Xn < 10-Xio, 

= 10 - Xii & ^2 = 10 - Xio ^ ^3 < 10 - Xg, 

'■ (7) 

Note that of the four symmetric solutions given earlier, only 
(4) with Xi — 2, X2 = 8 and Xn = 7 satisfies all three sets 
of symmetry breaking constraints: (5), (6) and (7). The other 
three solutions are eliminated. This leaves the question of 
where symmetry breaking constraints like (6) and (7) come 
from in general. Our work helps answer this question. 

Formal background 

A constraint satisfaction problem consists of a set of vari- 
ables, each with a domain of values, and a set of constraints 
specifying allowed combinations of values for given sub- 
sets of variables. Variables take one value from a given fi- 
nite set. A solution is an assignment of values to variables 
satisfying the constraints. Symmetry occurs in many con- 
straint satisfaction problems. A value symmetry is a per- 
mutation of the values that preserves solutions. More for- 
mally, a value symmetry is a bijective mapping, cr of the 
values such that if Xi = di, . . . , Xn = dn is a solution 
then Xi = a{di),...,Xn = cr((i„) is also. For exam- 
ple, in the all interval series problem, the value symmetry 
a maps the value i onto n — I ~ i. A variable symme- 
try, on the other hand, is a permutation of the variables 
that preserves solutions. More formally, a variable sym- 
metry is a bijective mapping, 9 of the indices of variables 
such that if Xi ~ di, . . . , Xn — dn is a solution then 
Xe{i) = di, . . . , Xgi^n) — dn IS also. For example, in the 
all interval series problem, the variable symmetry for revers- 
ing a series maps the index i onto n — i + 1. Symmetries are 
problematic as they increase the size of the search space. For 
instance, m interchangeable values increases the size of the 
search space by a factor of m!. 

Lex-Leader method 

One simple and effective mechanism to deal with symme- 
try is to add constraints which eliminate symmetric solu- 
tions ( jPuget 1993] ). For variable symmetries, Crawford et 
al. give a simple method that eliminates all symmetric solu- 
tions (Crawford et a l. 19961 ). The basic idea is very simple. 
We pick an ordering on the variables, and then post sym- 
metry breaking constraints to ensure that the final solution 
is lexicographically less than any symmetric re-ordering of 
the variables. For example, with a reversal symmetry which 
maps Xi to Xn-i+i, we post the lexicographical ordering 
constraint: 

[Xi, . . . , Xn] <lcx [Xn, ■ ■ ■ , Xi] 

This selects the "lex leader" assignment. Note that if Xi are 
all-different, as they are in the all interval series problem, we 



can simplify this lex leader constraint to give as in (5): 

Xl < Xn 

The lex-leader method lies at the heart of most static 
methods for breaking variable symmetry. In their survey 
of symmetry breaking in constraint programming in the re- 
cent Handbook of Constraint Programming, Gent, Petrie and 
Puget observe that: 

". . . lex-leader remains of the highest importance, be- 
cause there a number of ways it is used to de- 
rive new symmetry breaking methods . . . [however] the 
lex-leader method is defined only for variable sym- 
metries . ..a proper generalisation of lex-leader to 
deal with value symmetries would be valuable, even 
if restricted to some special cases ..." page 345 
( |Gent, Petrie, & Puget 2006] ) 

This is the research challenge we have been tackling in 
our recent work dWalsh 2006allWalsh 2007] l. 

Value symmetry 

In d Walsh 2006al l, we propose a generalization of the lex- 
leader method that works with any type of value symme- 
try. Suppose we have a set E of value symmetries. We 
can eliminate all symmetric solutions with the constraint 
ValSym(I;, [Xi,.. ., X„]) which ensures for all ct e E: 

[Xi,...,Xn] <lex [(T{X{),...,a{Xn)] (8) 

Where Xi to Xn is any fixed ordering on the variables and 
(j{Xi) represents the action of the symmetry a on the value 
assigned to Xi. For example, if a inverts values by mapping 
i onto n — 1 — i as in the all interval series, we can simplify 
(8) to give: 

[^1,^2,...] <icx [n-\-Xi,n-l-X2,..] 

Expanding the definition of lex, and exploiting the fact that 

Xl 7^ X2, we get as in (6): 

Xl < n - 1 - Xl, Xi=n-l-Xi^ X2<n-l-X2 

We give a linear time propagator for lex-leader constraints 
like (8), and show how to extend the lex-leader method to 
symmetries which act on both variables and values simulta- 
neously. 

In theory, this generalization of the lex-leader method 
solves the problem of value symmetries as it eliminates all 
symmetric solutions. Unfortunately, several problems re- 
main. First, the set of symmetries E can be exponentially 
large (for example, there are m! symmetries if we have m 
interchangeable values) requiring us to post a large number 
of lex ordering constraints. Second, decomposing ValSym 
into separate lex ordering constraints hinders propagation 
and may prevent all symmetric values from being pruned. 
In (Walsh 2006a), we give a simple example where this de- 
composition hinders propagation. Somewhat surprisingly, 
there is little hope to overcome this second problem. We 
prove in dWalsh 20071 ) that pruning all symmetric values is 
intractable in general even with a small number of symme- 
tries (assuming P ^ NP). 



Theorem 1 Pruning all inconsistent values for 
ValSym(E, [Xi, ., X„]) is NP-hard, even when jSj is 
linearly bounded. 

Proof: In ( IWalsh 2007"] l. we reduce 3-SAT to deciding if a 
particular ValSym constraint has a solution. □ 

With value symmetry, whilst pruning all sym- 
metric values is NP-hard, method likes those in 



( |Roney-Dougal et al. 2004[ [Puget 2005 ) will eliminate 
all symmetric solutions in polynomial time. Despite the 
negative result given in Theorem 1, value symmetry appears 
easier to break than variable symmetry both in theory and 
in practice. For example, with variable symmetry, we prove 
in jBessiere et al. 2004] l that just eliminating all symmetric 
solutions is itself NP-hard. 



Interchangeable values 

So far, we have considered symmetries in general and ig- 
nored any special properties of the symmetry group. A com- 
mon type of value symmetry with special properties that 
we can exploit is that due to interchangeable values. We 
can break all such value symmetry using value precedence 
dLaw & Lee 2004l i. an idea which has been used in many 
contexts including the least number heuristic fZhang 1996 ). 
To ensure value precedence, we can use the global constraint 
Precedence([Xi, .,Xn]). This holds iff the first time we 
use i is before the first time we use k for all j < k. For 
example, consider an assignment like: 

Xi,X2,X3,...,X,, = 1,1,2,1,3,. ..,2 (9) 

This satisfies value precedence as 1 first occurs before 2, 
2 first occurs before 3, etc. Now consider the symmetric 
assignment in which we swap 2 with 3: 

Xi,X2,X3,...,Xn = 1,1,3,1,2,. ..,3 (10) 
This does not satisfy value precedence as 3 first occurs 
before 2. Posting a PRECEDENCE constraint eliminates 
all symmetric solutions due to interchangeable values. In 
(fWalsh 2006b), we give a linear time propagator for the 
Precedence constraint. In (IWalsh 20071 ). we argue that 
Precedence is in fact equivalent to ValSym. 

Another way to ensure value precedence is to channel into 
dual variables, Zj which record the first index using each 
value j (Puget 2005). This maps value symmetry into vari- 
able symmetry on the Zj. We can then break this variable 
symmetry by posting simple ordering constraints: 

Zi<Z2<Z3<...<Z„, (11) 

This ensures that the first occurrence of 1 is before that of 
2, that of 2 is before 3, etc. For example, the assignment 
in (9) satisfies (11) as Zi = 1, Z2 = 3 and Z3 = 5. 
However, the symmetric assignment in (10) does not sat- 
isfy (11) as Z2 = 5 but Z3 — 3. Puget proves that we 
can, in fact, break any value symmetry with a linear number 
of ordering constraints on the Zj . Unfortunately, even with 
just two value symmetries, Puget's method hinders propaga- 
tion ( IWalsh 20071 ). This is supported by the experiments in 
( IWalsh 20071 ) where we see faster and more effective sym- 
metry breaking with the global PRECEDENCE constraint. 
This is therefore a promising method to eliminate the sym- 
metry due to interchangeable values. 



Dynamic methods 

An alternative to static methods which add constraints 
to eliminate symmetric solutions are dynamic methods 
which modify the search procedure to ignore symmetric 
branches. For example, with value symmetries, the GE- 
tree method dynamically eliminates all symmetric solutions 
from a backtracking search procedure in 0{n* log(?i)) time 
( Roney-Dougal et al. 2004). Dynamic methods have the ad- 



vantage that they do not conflict with the branching heuris- 
tic. However, dynamic methods do not prune the search 
space as much. Suppose we are at a particular node in the 
search tree explored by the GE-tree method. The GE-tree 
method essential performs only forward checking, pruning 
symmetric assignments from the domain of the next branch- 
ing variable. Unlike static methods, the GE-tree method 
does not prune deeper variables. By comparison, static sym- 
metry breaking constraints can prune deeper variables, re- 
sulting in interactions between the problem constraints and 
additional domain prunings. For this reason, static symme- 
try breaking methods can solve certain problems exponen- 
tially quicker than dynamic methods. 

Theorem 2 There exists a model of the pigeonhole problem 
in n variables and rt + 1 interchangeable values such that, 
given any variable and value ordering, the GE-tree method 
explores 0(2") branches, but which static symmetry break- 
ing methods like value precedence solve in just 0{n^) time. 

Proof: See (IWalsh 20071 ). □ 

This theoretical result supports the experimental results in 
( Puget 2005 ) showing that static methods for breaking value 



symmetry outperform dynamic methods. Nevertheless, dy- 
namic methods have been found useful as they may not con- 



flict with the branching heuristic ( |Gargani & Refalo 2007 



Van Henteru-yck & Michel 2008 ). An interesting direction 
for future work are hybrid methods that combine the best 
features of static and dynamic symmetry breaking. 

Related work 

Puget proved that symmetric solutions can be elimi- 



nated by the addition of suitable constraints (Puget 1993). 
Crawford et al. presented the first general method 
for constructing variable symmetry breaking constraints 
dCrawford ef g/. 19961 ). To deal with large number of sym- 
metries, Aloul et al. suggest breaking only those symmetries 
which are generators dAloul et al. 2 002 ). Puget and Walsh 
independently proposed propagators for value symmetry 
breaking constraints (Puget 2006 IWalsh 2006al ). To deal 
with the exponential number of such value symmetry break- 
ing constraints, Puget proposed a global propagator which 
does forward checking in polynomial time ( Puget 2006| ). 

To eliminate symmetric solutions due to interchangeable 
values. Law and Lee defined value precedence for finite do- 
main and set variables and proposed a specialized propaga- 
tor for a pair of interchangeable values {Law & Le e 2004) . 
Walsh extended this to a propagator for any number of in- 
terchangeable values ( IWalsh 2006bl ). Value precedence en- 
forces the so-called "least number heuristic" ( [Zhang 1996 ). 
Finally, an alternative way to break value symmetry stati- 
cally is to convert it into a variable symmetry by channelling 



into a dual Boolean viewpoint in which Bij ~ 1 iff Xi — 
j, and using lexicographical ordering constraints on the 
Boolean variables (Fle neref a/. 20021 ILaw & Lee 20061 1. 
More recently, static symmetry breaking constraints have 
been proposed to eliminate the symmetry due to both 
interchangeable variables and values JFlener et al. 20061 
ILaw et al. 2007l l. 

A number of dynamic methods have been proposed to 
deal with value symmetry. Van Hentenryck et al. gave a la- 
belling schema for eliminating all symmetric solutions due 
to interchangeable values (Van Hentenryck et al. 2003 1. In- 
spired by this method, Roney-Dougal et al. gave a polyno- 
mial method to construct a GE-tree, a search tree without 



value symmetry (Roney-Dougal ef a/. 2004 1. Finally, Sell 



mann and van Hentenryck gave a 0[ndf' ° + n^(P) domi- 
nance detection algorithm for eliminating all symmetric so- 
lutions when both variables and values are interchangeable 
( SeUmann & Van Hentenryck 2005^ . 



Conclusions 

Value symmetries can be broken either statically (by adding 
constraints to prune symmetric solutions) or dynamically 
(by modifying the search procedure to avoid symmetric 
branches). We have shown that both approaches have 
computational limitations. With static methods, we can 
eliminate all symmetric solutions in polynomial time but 
pruning all symmetric values is NP-hard in general (or 
equivalently, we can avoid visiting symmetric leaves of 
the search tree in polynomial time but avoiding symmet- 
ric subtrees is NP-hard). With dynamic methods, we can 
take exponential time on problems which static methods 
solve without search. Nevertheless, experimental results in 
( |Puget 20061 IWalsh 2006bl IWalsh 2006al IWalsh 20071 1 and 
elsewhere show that value symmetry can be dealt with ef- 
fectively in practice. 

These results may be useful to researchers in closely re- 
lated areas like planning and scheduling where value sym- 
metries arise and need to be eliminated. They may also be 
useful in areas like model counting, verification, and auto- 
mated reasoning as value symmetry arises in many of these 
problems too. There are many open questions raised by this 
research. For example, are there symmetries where all sym- 
metric values can be pruned tractably? How do we combine 
the best features of static and dynamic symmetry breaking? 
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